Active Domain Adaptation with Multi-level Contrastive Units for Semantic Segmentation
نویسندگان
چکیده
To further reduce the cost of semi-supervised domain adaptation (SSDA) labeling, a more effective way is to use active learning (AL) annotate selected subset with specific properties. However, tasks are always addressed in two interactive aspects: transfer and enhancement discrimination, which requires data be both uncertain under model diverse feature space. Contrary classification tasks, it usually challenging select pixels that contain above properties segmentation leading complex design pixel selection strategy. address such an issue, we propose novel Active Domain Adaptation scheme Multi-level Contrastive Units (ADA-MCU) for semantic image segmentation. A simple strategy followed construction multi-level contrastive units introduced optimize supervised learning. In practice, MCUs constructed from intra-image, cross-image, cross-domain levels by using labeled unlabeled pixels. At each level, define losses center-to-center pixel-to-pixel manners, aim jointly aligning category centers reducing outliers near decision boundaries. addition, also introduce categories correlation matrix implicitly describe relationship between categories, used adjust weights MCUs. Extensive experimental results on standard benchmarks show proposed method achieves competitive performance against state-of-the-art SSDA methods 50% fewer significantly outperforms large margin same level annotation cost. Code will https://github.com/haoz19/ADA-MCU .
منابع مشابه
Unsupervised Domain Adaptation for Semantic Segmentation with GANs
Visual Domain Adaptation is a problem of immense importance in computer vision. Previous approaches showcase the inability of even deep neural networks to learn informative representations across domain shift. This problem is more severe for tasks where acquiring hand labeled data is extremely hard and tedious. In this work, we focus on adapting the representations learned by segmentation netwo...
متن کاملSemantic Segmentation via Multi-task, Multi-domain Learning
We present an approach that leverages multiple datasets possibly annotated using different classes to improve the semantic segmentation accuracy on each individual dataset. We propose a new selective loss function that can be integrated into deep networks to exploit training data coming from multiple datasets with possibly different tasks (e.g., different label-sets). We show how the gradient-r...
متن کاملTarget contrastive pessimistic risk for robust domain adaptation
In domain adaptation, classifiers with information from a source domain adapt to generalize to a target domain. However, an adaptive classifier can perform worse than a non-adaptive classifier due to invalid assumptions, increased sensitivity to estimation errors or model misspecification. Our goal is to develop a domain-adaptive classifier that is robust in the sense that it does not rely on r...
متن کاملSample-oriented Domain Adaptation for Image Classification
Image processing is a method to perform some operations on an image, in order to get an enhanced image or to extract some useful information from it. The conventional image processing algorithms cannot perform well in scenarios where the training images (source domain) that are used to learn the model have a different distribution with test images (target domain). Also, many real world applicat...
متن کاملLearning Multi-level Region Consistency with Dense Multi-label Networks for Semantic Segmentation
Semantic image segmentation is a fundamental task in image understanding. Per-pixel semantic labelling of an image benefits greatly from the ability to consider region consistency both locally and globally. However, many Fully Convolutional Network based methods do not impose such consistency, which may give rise to noisy and implausible predictions. We address this issue by proposing a dense m...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture Notes in Computer Science
سال: 2023
ISSN: ['1611-3349', '0302-9743']
DOI: https://doi.org/10.1007/978-3-031-26293-7_27